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Abstract 


Packet delays and queue lengths aie important indicators of the quality of sen ice 
offered at a node in a telecommunications network These parameters cannot be easily 
measured This necessitates the estimation of these parameters from other more easily 
rvailable information like the traffic arrival rates to nodes the departure instants of 
packets or the cumulative departure counts Queue inferencing is a technique to estimate 
the queueing parameters using this kind of transactional data 

Many queue inferencing algorithms have been de\ eloped All of these algorithms 
require detailed transactional data of the service initiation and termination instants of 
packets In this thesis we have proposed queue inferencing schemes that require less 
detailed data to estimate the packet deliys and queue lengths We concentrate on the 
queue inferencing using the cumulative departure count information This information 
is more easily available from the network management information bases and is also less 
informative This information is collected by the network manager by polling the node 
at regular intervals 

In the first method that we study we divide the polling interval into cycles comprising 
of an idle period and its adjacent busy period We then distribute the total departures 
among these busy periods to generate the kind of data required by existing queue in 
ferencmg algorithms We then use this data in the queue inferencing algorithms and 
estimate the waiting times We study the performance of this technique by evaluating 
the errors and the bias in the estimates by comparing the estimates with the 1 real values 
from simulation 

Next we derive an 0(d) formula for estimating the queue length at the end of a 
given time interval, which we call as the “residual’ queue length, using the information 
of the cumulative departure count, d We derive an expression for the joint probability 
distribution of the cumulative departures and the residual queue length, and use this 
result to derive our estimation algorithm We also present some numerical results for our 
algorithm 
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Chapter 1 


Introduction 


To guarantee a minimum quality of serv ice for the applications running over a network 
we need proper management Among the most important parameters defining the quality 
of service are the delays that the data packets experience en route from source to des 
tinatiori and the queue lengths encountered by the packets at network nodes A direct 
measurement of these parameters is difficult We can, however, estimate these parame 
ters from more easily available data like the data of packet departure instants at a node 
or the departure counts, or similar data about the traffic transacted at the node Queue 
inferencmg is the technique for estimation of queue parameters using such transactional 
data 

Various network management applications, like SNMP agents provide different types 
of data about the nodes they are monitoring e g the number of data packets transacted 
in a given interval and the number of erroneous data packets received We may also log 
more detailed transactional data like the arrival and departure instants of the packets 
processed at a node The cost of gathering detailed data is a higher consumption of 
network resources and the cost paid towards its dissemination to the managing agent 
is even higher in terms of these resources Hence algorithms requiring a less detailed 
set of data assume importance The earlier queue inferencmg ilgorithms require detailed 
transactional data of the departure instants and busy period initiation instants and hence 
has limited practical utility In this thesis, we have developed methods to estimate queue 
parameters fiom the information about the cumulative departures m a time interval 
This is more easily obtained from the SNMP agents and also consumes less network 
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bandwidth during dissemination 


1 1 Motivation 

Queue mferencing techniques estimate queueing information using the transactional data 
of a queueing s\stem eg a node m a data network The incoming packets at the node 
are the customeis which join the queue and after being processed leave the system A. 
common model for the network traffic incident at a node is a Poisson process and that 
for the node is an M/M/1 queueing sjstem [KLECN] Various performance parameters 
of the node ma\ be estimated using queue mferencing algorithms 

A major drawback of the existing queue mfeicncmg algorithms is the requirement of 
detailed transaction il data which limits the practical utility of these algorithms This 
has motrvated us to de\elop some queue mferencing techniques requiring less detailed 
transactional data 

In this thesis we first present a scheme to estimate the waiting times of customers 
in a queue using known queue mferencing algorithms We use the easily obtainable 
transactional data of the cumulative departure count during a time interval as the input 
m the scheme This data is less informative and our scheme is therefore less accurate than 
the case when the detailed service initiation and termination information is available 

Next we develop an 0(d) algorithm for estimating the queue length at the end of a 
given time interval called the ‘ residual queue length We derive an expression for the 
joint distribution of residual queue length and the cumulative departure count in a given 
time interval, and use it to derive our algorithm This algorithm assumes the knowledge 
of the utilisation of the server 

1 2 Organisation of the Thesis 

In this thesis, we propose queue mferencing schemes to estimate the waiting times of 
customers in an M/M/ 1 queue and discuss their error performance We later develop an 
algorithm for estimating residual queue lengths conditioned on the cumulative departure 
information We discuss these separately 

In chapter 2 we discuss the previous work on queue mferencing techniques We then 
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propose our scheme for estimation of waiting times of customers We discuss the errors 
m the estimate by compaung with simulation results We also propose some correction 
techniques to this scheme In chapter 3 we derive an 0(d) formula to estimate the 
queue lengths at the end of a given time interval using the cumulative departure count 
information After discussing the approach we derive the joint distribution of the residual 
queue length and the cumulative departure count We then develop our estimation 
algorithm Our algorithm assumes the knowledge of armal rate of customers to the 
queue We discuss the estimation technique to measure the utilisation of the server 
Finally chapter 4 summarizes the work and identifies avenues for future work 
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Chapter 2 


Queue Inferencing . Theory and 
Algorithms 

2 1 Introduction 

Consider a queueing system for which the transactional data are recorded m the foim 
of service commencement and service completion times for each customer served This 
transactional data when rank ordered, allow the identification of busy and idle periods 
in the queueing system Larson [Lar90] proposed a method to estimate the transient 
queue lengths during a busy period from this transactional data Since the publication 
of this result algorithms to infer queue lengths and waiting times from transactional data 
have been proposed In the next sectio i we discuss the early work of Larson [Lar90] 
and the algorithms proposed by Bertsimas and Servi [BeS92] In section 2 3 we discuss 
the algorithms developed by Daley and Servi [DaS92] using Markov chain techniques 
and taboo probabilities In section 2 4 we discuss the feasible arrival vector model of 
M mjunath and Molle [MaM96] Finally in section 2 5 we present a scheme to use queue 
inferencing techniques with only cumulative departure count information We develop 
the theory and present some experimental results for this scheme 


4 


2 2 Early Work 


Larson [Lai 90] proposed two algorithms to estimate the queue lengths during a busy 
period of an FCFS queue He based his algorithms on the following two observations 

1 The ending of each busy period can be identified by a service completion time w hich 
is not immediately followed by a new service commencement The subsequent 
seivice initiation is the beginning of a new busy period 

2 In a busy period, a service commencement at time t x implies that the arrival time 
of the corresponding customer must be between the arrival time of the previous 
customer and t t Further if the arrival process is known to be Poisson the a 
posteriori probability distribution of the arrival time of this customer must be 
uniformly distributed in the specified interval 

The approach focuses on a single busy period Since the completion (or commence 
ment) of a busy period constitutes a renewal point in any Poisson arrival queue the 
solution for one busy period is also the solution for any time period having an arbi 
trary number of busy periods Larson used these observations to derive 0(n 5 ) and 0(2 l ) 
algorithms to compute the transient queue lengths during an n customer busy period 

Bertsimas and Servi [BeS92] proposed an 0(n 3 ) algorithm which estimates the queue 
lengths during a busy period A brief discussion of their work follows 

Consider an n customer busy period of an FCFS single server queue with Poisson 
arrivals that started at time t 0 Let r, be the (unknown) arrival time and t t the service 
completion time of the zth customer Let N(t) be the cumulative number of arrivals m 
time [t 0 t) and Q(t) be the number of customers m the queue at time t~ Without loss 
of generality we can define t 0 = 0 In a busy period a service commencement at time 
tj implies that the (j + l)th customer must have arrived before the departure of the jth 
customer Let 0(t) be the event {0 < T 2 < < 73 < * 2 , r n _i < r n < t n _i} Let 

0(t, n ) = 0(t) n {N(t n ) — n} 

If the ai rival process to the queue is Poisson, the a posteriori probability distribution 
of the yth customer must be uniform in the interval between the arrival instant of the 
(j — l)th customer and its departure instant Thus, the joint density of the event 
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{r 2 = T X 


r n = x n _i} conditional on N(x n ) = n is given by 

f{n = x i r n = x n -i\N(x n ) - n) = -_- p- (2 1) 

x n 

Therefore 

(71 — 1)' /•*! rU /■* 

Pr{r 2 <ti, r n < t n ..i\N{t n ) = n} = — r- - / / dx 2 dx n 

=0 Jx$=x2 Jx =iji - 1 

(2 2 ) 

Then the estimate of the cumulative number in system at time t 0 < t < f n for an 
n customer busy period can be shown to be given by 

£W)|0(i n)j = (l-0)£;[/V(^_ 1 )] + ^[iV(f J )] for £.,_i <t<t 3 (23) 

where 

^rxr 1 - PU 

Ij— 1 

Here is the expected number of cumulative arrivals at the departure instant of 

the yth customer in the busy period E[N(t.))] is given by 

£[JV(t,)l = h)=mtn)} (2 5) 

k=] 

Efficient methods have been derived for the calculation of Pr{N(tj = k\0(t n)} by 
Bertsimas and Servi [BeS92] The queue length estimate at time t Q(t ), is given by 

Q(t) = jV(t) - j for tj-i <t<tj (2 6) 

Bertsimas and Servi also generalized the algorithm for the case of stationary mterar 
rival times from an arbitrary distribution They also proposed an 0(n) on line algorithm 
to dynamically update the current estimates for queue lengths after each departure 

2 3 Taboo Probabilities Daley and Servi 

Daley and Servi [DaS92] exploited Maikov Chain techniques and used taboo probabilities 
to estimate queue lengths from transactional data They constructed an exact 0(n 3 ) and 
an approximate 0(n 2 log n) algorithm for busy periods with n customers for a single 
server FCFS queue They used the observation that the queue is never empty at any 
service completion instant (except that of the last customer) in a busy period In other 
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words the queue being empty at any departure instant inside a busy period is a taboo 
e\ent The queue length at the instant of service completion of the / th customer inside 
an n customer busy period (r < n) may then be expressed m teims of Markov chain 
transitions comprising only of non taboo events since the beginning of the busy period 
They considered an n customer busy period of a single server FCFS queue with service 
times Si, ,S n Si s are known and no assumptions are made about their statistics 
Let t 0 denote the beginning of the busy period and for r = 1 n define 

t r = to 4- S\ + + S r — f r _i + S r (2 7) 

Observe that t r (t r _i) is an epoch of service completion (commencement) of the rth 
customer in a busy penod the values of Si S n are known (hence the t T s are known) 
t n is the epoch of busy period completion 

Let JV(£) be the number of customers in the queue at time t (excluding the customer 
in service) at time t, to < t < t n N(t ) is left continuous i e N(t) = N(t~) N(t 0 ) = 1 
and N(t n ) — 0, and the event N(t s ) = 0 for t 0 < t s < t n is a taboo event The arrival 
process to the queue is Poisson (We do not need to know the rate of the arrival process) 
Define a subset of the complement of the taboo event as 

A ri r * £ {N(t s ) > 0 s = ri ,r 2 } (2 8) 

A rir 2 is the event that the busy penod did not end between £ n and t T2 By the left 
continuity of N(t), N(t r ) = N r = N(t~), and N(t+) = N(t r ) — 1 Then for j = 1 2 
and r = 1 , ,n— 1 , 

P r j]n = Pr{N r = j\Nq = l,iV s > l(s = 1 ,n - l),N n = 0} 

= Pr{N r — j\N 0 — l,A ln ~ l ,N n = 0}} 

Pr{N r =j A ln ~ l N n = QjA^o = 1} 

Pr { 41 n— 1 N n — 0) A/q — 1} 1 } 


p r ^ n is the probability of N r being equal to j in an n customer busy period (r < n), 
excluding all taboo events 

Using Feller s [FELL] notation for taboo probabilities we have 

0 = Pr{N s > 0(s = l ,r — l),N r — j |iV 0 = 1} 

= Pr{A l r ~ 1 ,N r = j|iVo = 1} (2 10) 
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0 p''J y is the probability of the queue being in state jq at the rith departure instant and 
in state J 2 at the r 2 th departure instant (r 2 > rq) with the queue ne\er being emptv at 
my intermedi ite departure instant Then 


oPj o = Pr{N s > 0(s = r + 1, n - 1) N n = 0|N r = j} 
= Pr{A r+ln ~ l N n = 0\N =j} 


(2 11 ) 


Using the Markovian property of {N r } the numerator of (2 9) can be expressed as 


Pr{N r =],A"-' N n = 0|A/„ = 1} = „ p°; oP :S 


(2 12 ) 


Using the Chapman Kolmogorov equations the denominator of (2 9) can be expressed 


pq/i 1 "- 1 Af, = oj<v„ = i} = op? 


E 0 r r n 

OPl h 0Ph 0 


(2 13) 


Therefore, we have 


Or r n 

P l\ n - On 
OPl 0 


As N r > N r -i — 1 and N n = 0 for a busy period of length n 


Pl|n=oPjo=0 for j > n — r 


(2 14) 


(2 15) 


Chapman Kolmogorov equations are used to compute the taboo probabilities recursively 
as gnen below for r = 1, n and j = 1,2 

«P° r , = Pr{A lr ~ l N, = j\N„ = l} 

J + l 

= J2Pr{A lr ~ 2 AT r _i = Z|iVo = 1} Pr{N r = j\N r -\ = 1} 

i = l 
j+i 

_0r — 1 r>_ -/ill fn -i 




(2 16) 


while 


— 


1 for ] = 1 
0 otherwise 


(2 17) 


where Y r denotes the number of arrivals during the rth service time of length S r 
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Also using the backward Chapman Kolmogorov equation for r = n — 1, 2 and 

] = 1, n + 1 - r, 

op;; 1 " = Pr{A'"-' N n = 0\N r ^ = j} 

= 2 Pt{N, = l\N r = 3 } / > r{4 r ” - 1 JV„ = 0|JV r = 1} 

l=mcix( 1 j-l) 

= £ Pr{n = l + l-j}orfJ (2 18) 

l—max( 1 j-l) 

and 


oPj 0 


= 6u Pr{Y n = 0} 


(2 19) 


All other terms oPj i 1 n 1 are 0 from (2 15) 

The queue length estimate at time t r to <t <t n is then given by 


^ = E^|n 

3=0 


(2 20 ) 


For an n customer busy period the computational complexity for an exact solution 
is 0(n 3 ) This can be reduced to <9(rc 2 logn) for an approximate solution based on a 
Gaussian approximation to a bound for N r 

Daley and Servi [DaS92] also give an O(n) algorithm for an online estimate of the 
queue length at any departure instant inside a busy period If only (t 0 ti t r ) are 

given and no information about events after time t T is given the probability that the 
queue length at time t r is j equals 

° Pl - J 0 ~ (2 21 ) 
E£ioP?i 

which can be used to compute the online estimate of the queue length at time t r 
These results are essentially a rederivation of the results m [BeS92] 


2 4 Feasible Arrival Vector Manjunath and Molle 

Manjunath and Molle [MaM96] proposed passive estimation algorithms for queueing 
delays in LANs and polling systems A brief description of these results follow 

Consider an interval 1 = (0, <„] that includes n customer arrivals from a Poisson 
source, subject to the constraints that the mth arrival occurred no later than time t m , 
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m— 1 n Let r m be the actual arrival time for the mth customer Define tq = 0 For 
a single server queue Z represents a busy period The interval Z and the constraints t m 
aie assumed to be known Define the vectors t— t 2 t n ] and Z= [d t 2 Eh] 
Now if n arrivals from a Poisson source occurred within the interval Z the joint 
density of their arrival times, f^(r) is given by 


fn(r) = 


n 1 


(2 22 ) 


This allows the first arrival to occur within the interval Z rather than defining its left 
hand boundary 

The arrivals are subject to the constraint that the mth arrival occurred before t m 
Thus for any feasible arrival vector r the corresponding joint density / n (r) is obtained 
from /„(r) by multiplying it by the normalization constant l/p n , where p n is the proba- 
bility that a randomly chosen arrival vector would satisfy these constraints p n is given 
by 


ftl ft! ft n Jl I 

Pn = / / / rr^ dr n dr 2 dr i (2 23) 

J Ti =qJti=Ti Jt =T,i_l [t n ) 

Therefore, the joint density of the arrival times given the constraint vector is given by 


fn{z) = < 


&& for i = 1 2 


0 


for i = 0 


(2 24) 


As long as r satisfies the given constraints, i e r 2 _i < r, < t, for all i = 1 2 n 
otherwise / n (r) = 0 

Define 4> p g (r p ) for q > p and p > 0 as 


&P q( r p) ~~ i 


(2 25) 


1 ior p — q 

{ f£i=r P frp+ 2 —Tp+i 4= r,., dr 0 dT P + 1 ior 9 > V 

It can be shown that <^ p q is a polynomial of degree q -p m r p and can be represented by 


q( T p) 


q-p 

E 

j=0 


'V ? 


0) 


where 


Cp g+l (0) 

c p<?+l0) 


*7+1 

c p+ i 9+ i(y) 

Cg+1 ^+iQ-l) 


J 


(2 26) 


(2 27) 
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After further manipulations p n and f n (r) reduce to 


w 


Mi) = 1 


(2 28) 
(2 29) 


</>o n(0) 

The minimum mean square error estimate Er m , of the arrival time of the mth cus 
tomer out of n in the interval 1 can be computed as given below 

Er m = [ [ r m f n (r) dr n dtr x 

Jt i=0 Jr —t — i 

1 [*' A 

= 1 — 7m / / r m dr » d E 

<P0n(U) 9r,=0 J —t _i 


This simplifies to 

n-rri+l 

Et ” = 5 c°) 5 Cm " (: ' _1) 


E(-l)‘ +I Cl-, tHm-.(0) ^ 


Now the waiting time of the mth customer m an n customer bus} period is 


(2 30) 


T n 


(2 31) 


Taking expectations, we get 

Ew m — t m — Er m (2 32) 

which may be computed using (2 30) Then the estimated queue length at the mth 
departure point is the difference between the estimated number of arrivals and the actual 
number of departures upto that point, namely m 


2 5 Estimating Queueing Using Cumulative Depar- 
ture Count Information 

The collection of data pertaining to the service initiation and completion times for all 
the customers served in a queueing system e g a node in a data network, amounts to a 
significant storage effoit on the pait of the monitoring agent The sheer volume of traf 
fic handled by the nodes limits the utility of queue inferencing algorithms that require 
extensive transactional data Hence algorithms requiring less frequently collected data 
assume importance for real networks Such data may, however, be less informative The 
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cumulative number of depaituies m a given interval can be easily obtained from network 
management agents We intend to use existing queue mferencmg algorithms to estimate 
the customer waiting times m a single server queueing sjstem using the cumulative de 
parture count information and the arrival rate information The development of this 
queue mferencmg method for an M/M/1 queue is discussed below 

The state of the server in a queue alternates between idle when the system is emptv 
and busy , when a customer is receiving service at the server For a single server system 
the idle ’ period of the server corresponds to the idle period of the queueing system and 
the period duung which the server is providing service to customers constitutes a busy 
period of the system The busy periods and the idle periods alternate m a queueing 
system An idle period and an adjacent busy period constitute a cycle of the system 
We divide the polling mteival into cycles of steady state average length comprising of 
steady state avenge length idle and busy periods since these are the minimum mean 
square error estimates ( MMSE ) We distribute the total departures uniformly among 
these busy periods Thus we geneiate the kind of data as required by existing queue 
mferencmg algorithms, and use these algorithms to estimate the waiting times of the 
customers We will use the algorithm of Manjunath and Molle [MaM96] for a single 
server FCFS queue in our scheme In the next section we will justify our choice of a 
uniform distribution for the total departures among the MMSE cycles 

2 5 1 Distribution of Departures among the “Busy Periods” 

We want a method to distribute the cumulative departures N, that occurred m a polling 
interval among the MMSE ‘busy periods’ Let the polling interval be divided into k 
cycles, and hence k busy periods Let us denote by n the number of customers allocated 
to the ith busy penod Let us define n = [ni,r> 2 , n k } The distribution of customers 
among the k busy periods is subject to the constraint that the sum of the customers 
allocated to all (i e k ) busy periods must be equal to the total number of departures 
i e $ N 

Recognizing that but for the above constraint, the n t s are lid random variables we 
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hue a situ ition smulai to i pioduct hum que uem., network Theufoic 


Pi{r\ = = lllhll i 11 ’) jM 

P’{Z # = 1 n,=iV} 


2=1 


(2 33) 


w he u / (tij) is the piob ibilitv miss function for the number of customeis served in the 
ith bus\ pc nod From [I\LEI\](p 218) /(n t ) is given bv 


/(«») = ~ 
n 

and 

Sine c n, s tie nd i \ndom un ibles 

k 


2 n, - 2 

n, - 1 


d+p ) 1 




(2 34 ) 


(2 3.) 


P; {5Z n » =V } = f(n)®f{n)® ®/(ra) 

. S— ^ — » 


1=1 


A. times 


= / W MI 


(2 36) 


Theiefoie fiorn (2 33) and (2 36) we have 

k 

Pr{n | £ n = /V} - 


i=i 


/( rci)/(n 2 ) /K) 


(2 37) 


Thus we see that the probability mass function for n is independent of airy peimu 
t ition of a given instance of n The symmetiy of the joint piobabihtv mass function 
points to the uniform distribution of customers to all the busy periods as being the 
mean case So a uniform distribution i e n t = ( V/A) foi i — 1 2 will mmimizp the 
van rnce 


2 5 2 Numerical Results 

In the proposed scheme we divide the polling interval in \IMSE cycles consisting of 
MMSE idle periods and adjacent MMSE busy periods We then distribute the total de 
paituies in that mtcival uniformly among the busv penods to generate the data inquired 
by the existing queue mfeiencmg techniques We estimate the waiting times using the 
queue mfcrencmg ilgonthm proposed by Manjumth and Wolle [MaM96] 

We earned out simulation of an M/M/1 FCFS queue for the purpose of testing the pro 
posed scheme Tests were run using polling intervals of different sizes (100 200 500 1000 
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// 1 unit's) foi vw i ige urn d 1 it< ( \) i uiging fiom 0 1 to 0 9 (noimih/ed w i t the 
i\ei\ge spi \ r ( late /i) Timo is mtisuied m units of average smiu turn // _1 The 
estim itid waiting tunes vie compaied with the actual values and the bias m estimation 
is computed It is obstivcd tint the scheme is biased towaids giving a lower estimate 
The results aie piesented m t ibles 2 1 2 4 It mat be observed from these tallies ind 

fig 2 1 that the proposed scheme is biased towards lowpr estimates which worsen with 
mcieasmg A It may also be noted that the perfoimance is unaffected b\ the < hone of 



Arrival Rate ( X. ) 

Figure 2 1 Variation of bias with A 

2 5 3 “Offset” at the Polling Edge 

Our scheme assumes that given a piopei choice of polling inters al sue T we can ha\e 
exactly k = T/c busy periods inside the polling interval This implicitly assumes that 
the leading edge of the polling interval falls in an idle period Let the distance of the 
leading polling interval edge from the beginning of the subsequent busy period be called 
as the offset If the leading polling interval edge falls in a busy period the offset 
is the difference between the beginning of the current busy period and the polling edge 
and is taken to be negative in this case (fig 2 2) Let us denote the offset bj 3 Then 
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A 

Mean Estimated Waiting Time 

Bias 

0 100000 

0 049971 

0 061862 

0 200000 

0 097838 

0 226910 

0 300000 

0 170402 

0 449355 

0 400000 

0 289109 

0 799211 

0 500000 

0 469522 

1 390885 

0 600000 

0 743035 

2 517193 

0 700000 

1 146156 

3 990822 

0 800000 

1 736006 

7 511800 

0 900000 

2 857449 

■ ■ 

11 292483 


Table 2 1 Performance of scheme for polling interval size — 100 /i 1 


A 

Mean Estimated Waiting Time 

Bias 

0 100000 

0 042382 

0 082124 

0 200000 

0 091530 

0 239443 

0 300000 

0 166029 

0 461633 

0 400000 

0 286228 

0 805425 

0 500000 

0 468496 

1 394747 

0 600000 

0 742648 

2 516473 

0 700000 

1 146860 

3 988634 

0 800000 

1 738224 

7 497245 

0 900000 

2 860715 

11 278063 


Table 2 2 Performance of scheme for polling interval size = 200 n 1 
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Idle Period 



polling instuit 


offset 

(+ve) 


i 

■a-* 

I 


(a) 


Busy Period 


Idle Period 


I 

I 


US- 

I 


Busy Period 


offset 

( ve) 

polling instant 

(b) 


Figuu 2 2 Offset at the polling edge 


we have 


where 


1 \ 2 
(5 = Pi {idle}- - Pi {busy}^jj 

\ = average arrival rate to the system 

T = me rn busy period length 

second centi rl moment of the busy period length 


\ 2 


(2 38 ) 


For an M/M/1 for fx = 1 the values of X and \ 2 are given bv the following expres 


sions 


•Uso we hive 


\ 


\ 2 


1 

(1 - A) 

2 

(1- M 3 


Pi {idle} = 1-A 
Pr{busy} = A 


(2 39 ) 
(2 40 ) 


(2 41 ) 
(2 42 ) 


Hence we have, 

(1-A) A 
& ~ (1-A) 2 

(1-A) 3 -A 2 


(2 43 ) 
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Finnic 2 3 Bus Pafoimance aftei offset correction 

Thus \\( note tint the im in olFsct of the polling edge is non zero This is conti uv 
to our assumption tin! the offset is zero foi all \\lues of \ We tried to account foi 
this piobkrn m oui scheme but weie unable to find a suitable way of introducing the 
necessuy correction in ctse of negitive offsets fig 2 3 shows the bias m the results 
for the erses where tin offset is non negative The polling intervals chosen are 100p _1 
200p _1 500 p _l and 1000p -1 We can note the improvement in bias performance with 
this scheme as complied to the earlier method But this method cannot be used with 
higher values of A because the issociited negative offset cannot be corrected 


2 6 Discussion 

In this chapter, vve discussed the c uly work on queue inferencmg techniques We for mu 
lUed a queue mfticnc mg scheme to obtain writing times inquiring cumulative departure 
counts This scheme uses the information of the departure counts to generate the kmc! of 
information required by existing queue inferencmg techniques Existing queue mfeienc 
ing algorithms are then applied on this generated data to obtain waiting time estimates 
We checked the scheme by the way of simulation and found out that the scheme is biased 
towards giving smollei estimates thin the reil values We presented a scheme to account 
for the offset encountered by the polling edge We observed that this scheme has a better 
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mol p< ifonn mu but \u wen un iblt to find a w xa of ipph m 0 this offset Loinrtion foi 
tin Lisiswlu.it tin offst t is in pitiu 
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Chapter 3 


Residual Queue Length Estimation 

3 1 Introduction 

The inform ition ibout the number of departures occurring in a specified time interval is 
easy to obtain for a queueing system This information coupled with the knowledge of 
airival rate may be used to extract queue length estimates for the system at the end of 
the interval specified We will call the queue length at the end of such an interval as the 
residual’ queue length In this chapter, we present a method to estimate the residual 
queue length conditioned on the number of departuies in a specified time interval and 
the arrival rate to the queueing system 

In section 3 2 we discuss the approach to obtain the residual queue lengths for an 
M/M/1 queue In sect on 3 3, we derive the joint distribution for the departures and the 
queue length In section 3 4, we derive an formula for estimating residual queue lengths 
Our algorithm assumes the knowledge of arrival rate In section 3 5, we discuss the error 
involved in the measurement of arrival rates Finally we present some numerical results 
in section 3 6 

3 2 Residual Queue Length Estimation Theory 

Consider an M/M/1 queue Let the system be m the idle state at some time to Let us 
denote the residual queue length at time t 0 + 1 by Qt 0 +t Let us denote the depaitures 
in the interval by A 0+t Let D to+t = d Without loss of generality, we can define t 0 = 0 
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Then up have Qt — Qt 0 +t ' iu d D L — D t>+t — d Bv the Ira of total piobabihtv we hue 


Pr {Qt = i\D t = d} = 


Pi {Q t = i D, = d} 
Pr{D t = d } 


(3 1 ) 


Heie Pi {Qt — i\ Dt — d) is the piobabihty of the residual queue length being i iondi 
tioned on the numbei of departuies being d in interval (0 t] Pi {Q t = i D t = d) is the 
joint probability for the e\ent Qt — i and D t = d Pi { D t — d} is the piobabiht'v of d 
depu tuies occuning m the time inteivil (0 t] Then the estimate for the residual queue 
length is given by 


E{Q t \D t = d} = £rPr{Q ( = i|D t =rf} 
=o 

^ Pr{Q t = i D t =d} 
io* Pr{D t =d} 


(3 2 ) 


The probability of d departures or tuning in a time interval of size t for an M/M/1 
queue with arrival rate A is given by (COHEl\](pp 199 200) foi d = 0 1 t > 0 as 

(A t) d e~ Xt 


Pi {A = d} 


d' 


(3 3) 


The joint piobabihty foi D t and Q t is obtained in the next section 


3 3 Joint Density Function for Departures and Resid- 
ual Queue Length 


Consider an M/M/1 queue vvheic the u rival iate normalized to the service late is A D t 
is the number of dcpiiLuus duiing the interval (0 t] Let us define D 0 = 0 Let \ t be 
the system state at time t Let us define \o = 0 i e the system is consideied empty at 
the beginning of time interval (0 t] Let us define 


H lJ (t) = PT{\ l = i D t =j} 


(3 4) 


Let us define for \z\\ < 1, \z 2 \ < 1, Re s > 0 

OO OO rOO 

h(s,z u z 2 ) ± £2>v/ (35) 

i=0 j=0 J ° 

h„(s) = ["e-'HjW (3 6) 

Ct ' L'°RAR1 
21 „ „ * 

A 123431 



The c vpiession foi /?( b t ~>) is [COHE\](pp 197 198) 


/»(• 


i -> 


) = 


( 2 - OE^q/Io^) 


(3 7 


Wl ~ (1 + \ + )-l + 9 

Tilt denominator of (3 7) in vy be treated is a quadiatic in i Let us denote the mos 
of the denomm itoi bv ti(~?) and ? 2 ( 2 ) so that 

(1 + \ + i) + 1^(1 + A + s) 2 — 4 \~ 2 


L i{ 0 


2\ 


b(~) 


a (1 + A + a) - 1^(1 + \ + b) 2 - 4A„ 


2A 


(3 8) 
(3 9) 


It tan be proaecl b) Rouche s theorem that for Re s > 0 | ?| < 1 [COHE\](p 198) 

|Ji(~ 2 )| > 1 , |x 2 (^)l < 1 

Since h(s Z\ z 2 ) should be an analytic function of z x inside the unit rude for fixed s 
with Re 6 > 0 | 2 | < 1 it follows that r 2 ("o) should also be a zeio of the numeiatoi of 
(3 7) Hence foi |a | < 1 Re s > 0 

x 2 (z 2 ) 


Y^ h Qj{s)z2 ] = , , 

^ Z 2 ~X 2 (z 2 ) 

f . {z 2 - zi)x 2 {z 2 ) - (z 2 - x 2 {z 2 ))^ 

1 2 (z 2 — 2 2 ("2)) {A^i 2 — (1 + A + s)zi + Zo} 


We note that 


(3 10) 
(3 11) 


Aj2i 2 — (1 + A + s)zi + x-2 — A (zi — CC 1 ( 1^2 ) ) ( — 1 ^2 (" 2 )) 


(3 12) 


Hence in (3 11) wt g( t 

h(s 1 ,z 2 ) 


^(x 2 (z 2 ) - (~i)) 


(z 2 - x 2 {z 2 ))\{zi - zi(z 2 ))(zi - x 2 {^)) 

-22 

(z 2 - x 2 { 2 ))(d - Xi{z 2 )) A 


z 2 J Arr^)! Xi{z 2 )j 


(3 13) 


We choose s such that ( 2 : 2 ( 22)1 < \ Z A We also know that |zi| < 1 < l- r i( 2r, )l 
Expanding the right hand side of (3 13), we get 


h(b,zi z 2 ) = 


^f^)V 1 f/-iL-V 

^ I 22 J Aai(z2) ^0 IrN J 


(3 14) 
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Fiom (3 8) m<l (3 9) vv( h up 


l i( 2) i2(~ ) = ~~ 


Fioin (3 14) md (3 1 j) vv( get 
h(s , 




■j __ J *7 2 ) | /Tb) ^ I W ' ( t) 
1 = z 0 i n — 0 \ 

°o f ( \ ^ i+m+ 1 

\ m zi m V"' < zAkuHi 


m=0 /=0 l J 

Now J 2 n (^) i& given by the following relation [GOHEN](p 198) foi n = 1 2 


i2 n (*2) = i; 2 “W 

, =0 '» 


roo y n U 

e - (m+s)t raA 2r+t - lfU 
' 0 r'ln + z)' 


1 3 1 j) 

(3 lb) 
(3 17) 

(3 18) 


Hence we hue 


00 00 00 oo /] , . ■, \ \ .1 +/+ n 

h(,z, >)=E WIEV ,-l'W' ly t^ L— rff (3 19) 

171=0 /=or=o r'^ + m + z+l) 1 

This iniy be inverted wit s ?i md z 2 (ref \ppendi\ 4.) We then have H u (f) given 
bv 


H l3 (t) = 


7 


+j ^ 




-t 


m — 0 


(*+j)' 


(3 20) 


Recognizing that H l3 is the joint probability density for departuies and the iesidual queue 
length we get 

Pr{Q t = i A = j} = H J (i) (3 21) 

From (3 20) and (3 21) we have 


Pi {Q t = 1 D t = j} 


7 


(<- j)Ii 


l +J fir I /i+J 

1 + te~ t 


l 


E 

m=0 


m 


( l + j) 1 


(3 22) 


3 4 The Estimate of the Residual Queue Length 

With the help of the joint density function for departuies md residual queue length for 
an M/M/1 queue (3 22) and (3 3) we have 

d) e~ xt X l+d t d ~ l 


Pr{Q t = i\D t = d } 


e~ xt (Xt) d d' 




i+d jjn 


+te 


-t 


n=0 

t l+d 


in' 


W 

t 


(t-d) i-e^Efr + e 


i+d t 
m — 0 


(t + d)'J 

£i+d+ 1 


”» l , „-t, 

m 1 | (z + d) ! J 


(3 23) 
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The n the estimate foi nsicluil queue hngfh it tilt end of in obsuv lfion mtciv il of si/e 
t is n bv the following n 1 ition 


E{Q t \D t = d} = Y:>P{Qi=’\D t = d} 


i=Q 

X ) y 


= E'y 

, — n t 


i=0 

oo 


4 -d 


< f - d > fi— + 


+d-s 1 




n=0 m ' 


( i + d)* 


= -£ 


=0 ^ =0 
oo J.l+1 

+T l e- t >y * 

i=0 


-t i+d 

•iA 


(t - d)e~ t , £? 


-0 


in' 


(i + d)' 


(3 24) 


The abo\e equition ran be solved (ref Appendix A) to obtain an expression foi 
E {Q t \D t = d} is given below 

^ (t-d)\ ( t-d)e de^ 1 "^ 

£{Qt|A = d} = to rrrr ~ — Trrx~r - — — + 


(1 - \) 2 t (l-A)A rf -i (1 - \) 2 \ d t ' \ d ^ 

~ l te~ l 

V 


\ d 


(t d)(d+ 1) (t d)e . , -j. 

_ A)A d_1 ^ ^ ^ d 2) 


(1 - \)\ d t 


(1 - A) 2 Vi 


(1 - A)A (/ t 


(1 - \)t 

where 0(a n) is defined as 




(1 - A)^t 


0(a n) = ]£ 


(3 2d) 


(3 26) 


It may be noted that the given expression requires 0(d) calculations 


3 5 Traffic Arrival Rate Estimation 

The algorithm derived m (3 25) assumes the knowledge of normalized traffic aim tl rate 
An obvious way of obtaining this information is to measure the utilization of the server 
This is easily obtained by observing the friction of the time in some interval (0 t) that 
the server is busy The length for which this observation is to be carried out le the 
value of t depends on the accuracy with which we want to obtain A In [Kuma92] Kumar 
shows that the error in the estimate of (1 - A) obtained from this observation is bounded 
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Figuie 3 1 Estim xti d Queue Length fui \ = 0 o Points maiked foi D = Xt 


bv 


1 


1 - \i 1 — a 2 I (3i7) 

where A x is the arrival rate before the observation began and \ 2 is the actual aimal rate 
in the cunent window 


3 6 Numerical Results 

Equation (3 25) was used to estimate the residual queue length Q t \D t for vanous values 
of the amvd l ite (A), and for vanous vilues of time interval (t) Q t \D t as a function 
of d foi v uious v dues of t is shown in figures 3 13 4 It niaj be observed that as the 
v due of t men rsis the (Stinnted queue length for d = \t appioaches the steadv state 
value of ^rxj-, wlt h ^ ie 1111V ^ 1_lte normalized to the service rate It may also be seen 
that Q t \D=xt appioaches the steady state average value faster for smallei A This mav be 
observed from table 3 1 also where we have tabulated the values of Qt\D-\t for d = Xt 
for different values of A and t 
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Estimated queue length 







riguic 3 1 Estim itcd Queue Length for \ = 0 95 Points marked for D = 


Time 

(m units) 

Estimated Queue Length 

A = 05 

A = 0 7 

A = 09 

10 

0 80 OIIO 

1 253427 

1 3o2603 

20 

0 969804 

1 722327 

2 014822 

40 

0 998679 

2 124539 

2 997o68 

100 

1 000000 

2 323942 

4 925797 

200 

1 000000 

2 333275 

6 724913 

1000 

1 000000 

2 333333 

8 999621 

X 

l-X 

1 000000 

2 333333 

9 000000 


Table 3 1 The variation of Qt\D=xt wl th ^ 
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3 7 Discussion 


In this chaptei we presented a new ipproach to obtain residual queue length estimates 
using the cumulative departure count information We derived an expression for the joint 
probability distribution of the lesidual queue length and the cumulative departure count 
and derived our estimation foimula using the law of total probability The complexity 
of our estimation algorithm is 0(d) where d is the cumulative departure count We 
discussed a technique for estimation of arrival rate and the error involved therein Finally 
we presented some numerical results for our algorithm 
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Chapter 4 


Conclusions and Future Work 

4 1 Conclusions 

In this thesis we presented queue mferencmg methods which use the easily obtainable 
cumulative departure information for estimating queueing parameters 

First we proposed a scheme to estimate customer waiting times in an M/M/1 queue 
The proposed scheme divides a polling interval in cycles of steady state average size 
and uniformly divides the total departures in the polling interval among the cycles 
We discovered that the scheme is biased towards making too small estimates which 
worsened with the increase in the customer arrival rate We proposed a correction to the 
above scheme using the obseivation that the leading edge of the polling interval does not 
always fall in an idle penod We discovered that the bias performance improves after 
this correction but we could not formulate a way of applying this correction for higher 
arrival rate queues 

Next we developed an 0(d) algorithm for estimating the residual queue lengths using 
the cumulative departure count d We derived the joint probability distribution of the 
residual queue length and the cumulative departure count for a given time interval and 
used the fact that the departure process for an M/M/1 queue is also Poisson We derived 
our result using the law of total probability Our algorithm assumes the knowledge 
of customer arrival rate We discussed the technique for the measurement of server 
utilization factor, and the approximation involved We also piesented some numerical 
results 
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In the next section, we will discuss the possible use of PING for queue mferenemg 
which is a new direction for future work 


4 2 Queue Inferencmg using PING 

PINC or Packet InterNet Groper is a facihtv supported by TCP/IP networks to check 
whether a remote system is alive or not PINC sends constant (adjustable) size packets 
from the querying node to the queried node The queried node then echoes the packets 
back to the querying node PING packets carry the the timestamp of the transmission 
time This is used to calculate the round trip time This round-trip time is due to 
queueing delays at both the nodes and the delay experienced at the intermediate nodes 
Our interest would be to find out how this roundtnp time information provided by the 
PING packet can be used to estimate the delajs experienced by regular network traffic 

The system described above can be modelled as queueing system with two classes of 
customers PING packets are a class of customers originating from a regular possibly 
finite source The network traffic will be the second class of customers with Poisson 
arrivals from an infinite source It is obvious that the expected delays of the two classes 
of customers are different This means that the information obtained from the RTT of 
the PING packet does not directly indicate the delays of the other traffic We will need 
to use the RTT to estimate the delays experienced by the regular traffic by constructing 
the queueing model and obtaining the relation between the PING RTT and the queueing 
delays of the network traffic 

A queue inferencmg scheme that uses the RTT information from PING can be mod 
elled as a single server queue with two classes of customers one from an infinite Poisson 
source and other from a finite source which is fed back into the queue after a delay at the 
source The steady state solution for such system is presented in [Box85, DoW87 BoC91j 
These results may be used to develop this idea further 
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Appendix A 


A 1 Derivation of the Joint Density for Queue Length 
and the Number of Departures for an M/M/1 
Queue 


Foi \n M/M/1 quciu the \ due of h ( s ^ 2 ) i£> given b\ [COHEN](pp 197 198) 


< 1 


/ds , = ( - iM 2)-( -g ( )) i . u,| | ,i 

1 2 ' ( -r ( )){A ytl+A+s) H } 1 11 1 2 ' 

The roots of the quadratic term m the denominator of (A. 1) aie given by 


X\[ 


(*.) = <■+»+*! V<» A+ ; inea |a,( Z2 )|>l 


x 2 (zi) = IW-Vl™!‘± |x 2 (z 2 )|<l 


Therefore by choosing s such that 1 12 (^ 2 ) I < Nl have 

22 ( 2 - 2 ( 22 ) - ~i) 


h(s zi ~ 2 ) 


(zz - Iz{z2))\(zi - Ti(z 2 ))(a - ^’(- 2 )) 

f2 

{z 2 - - Zl) 


E 

m — 0 


r 2 (2,)] n 1 


£ 


Z\ 


A X!(- 2 ) to 2 ) 


We observe that X\(z 2 )x 2 (zo) = Z 2 /A Therefore 

OO 

h{s,zi z 2 ) = £ 


771=0 

00 


12(22) ] m 2-2(22) f 2 r ^ 2 ( 2 2 )A j 


22 

CO 


= E 2 S A ' E (Will 
h, Ail 2 2 J 


^2 ;-0 c 

i+m+1 


For r = 1,2, , [COHEN] (p 198) 

0 ° rz 

^ 2 (^ 2 ) = E#*J 0 

i=Q 


g-(l+A+s)f 


r\ n 


n'(r + n) 


- t 2n+T ~ l dt 


(Al) 

( A 2) 
(A3) 


(A4) 


(A 5) 


(A 6) 
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Hence we ha\e 


20 DC 


,-(i+A + S )t (l + rn + l)\ n ^ i 
n\l + m + n + l) 1 


h ( b 1 *2) - E 1 A ' E E " / e -(L + A + , )t +rn + l)A" ( 

l=j n=o n=o n)(l + m 4- n + IV 


Taking the imeisp Laplace transform m (A. 7) we get 

h{t ,! Z 2 ) = f'z'A' V V- V -. ^ + m + 1 ) e -(l+A)^n +t+ m 

Taking the inverse Z transforms m ( A 8) w r t and z 2 we obtain 

H ld (t) = e - (1+A > f V V .. . Xd t m + z + X ) t 2d+l+m 

~! q d){m 4 - i + d + l) 1 

Upon further simplification (A 9) G nes 


- \t Y+df-d - 1 


»-<*> = 3 — (*-<0 t-«-Eb +*«-' 


i-j-d im 


(» + <*)’ 


(A 8) 


(A 9) 


(A 10) 


A 2 Derivation of the Estimate of the Residual Queue 
Length for an M/M/1 Queue 


The queue length at tune t conditioned on there being d departures m intenal [0 t ) is 
given by 

m]D ‘ =d] = St HTStH'W 


t=o t L l ^o m ') {i + d)'\ 
™i\ l (t-d) ™i\Ht-d) t l +it m ™i\ l t t l+d+l 

T-V J -E- L r^TE^ + E T <'r^ 

I= 0 C 1=0 1 m= 0 Ul z=0 1 l lt U ) 


= t x -t 2 + t x 


^o ml To * (i + d) 1 

(All) 


Let us define 4>(a n) by 


0(a ^Ej 

1=0 L 


(A 12) 


We will now consider T\ T 2 and T 3 separately 


t. - E 


- d) 


(t — d)A 
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t 2 = 


We have 

T 2A 


The term T 2 x ( a ) 


(t - d ) A 1 

t (1 - A )^ 

(t — c?)A 

JT^Wt 

> ' t 6 im ' 


m=0 m 

jn -t oo i+d 

Lzif _ V 9 \ V 


oo i+d jm 

t S«A E ^ 

E t=0 771=0 

i ) e-t 

IZ 

:0 


" oo \i+d t+d + m 00 \i+d i+d /7 

S ,+i + 1 ) TE 5 -» + 1 % 2 ; 

L =0 A m=0 m 1=0 A 771=0 n 


L. — U III — U 

l\p—f 00 + d 

| ii Dt +( i +1)A ^ E ^ 

1 1=0 771=0 

. rl\e~t(rl 4- 11“ . l ±* 


djefjd + 1) “ „ ft r 

A J 7 tS ii m ' 


- 1 4 ^f> +i+i > A,+J £ 
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m 1 


fc=d 


771=0 


(t - d ) e " 
“ A d t 


A; d— 1 


LA:=0 

= T2A(a) “ T 2 j 4(6) 


E (* + m ‘ rsrE (‘ + D*‘E 


< t m 


771=0 


fc =0 


771=0 




is given by 

T 2 A(a) = 



A d t 

(*■ 

- d ) e~ t 


X d t 
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X d t 
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- d ) e~ t 
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(All) 


(A 15 ) 


(A 16 ) 
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The term 22 4 ( 6 ) is given by 


T; 


2A{b) 


^eW)a*£ 

(t - d)e 


i+d j.m 
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X d t 


k = o 

-i! d-1 d - 1 

-£ £(* + i)a 1 

m=0 k=m 


t m 


(±Z^K1 y- 1 N 1 " ')A m + A OT - <2(1 - A)A d - A d ] f 
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The term T^g can be evaluated as given below 

l +d j.m 


t 2B = 

\ d t V £; 


1=0 

oo 


m=O m ' 


= ( t ~ d ) e ~ t [d + 1) ^ k * t 

™ k 

E A *E 


_ (t - d)e~ t (d + 1) ^ , t A t m 


X d t 


k~ 0 m= 0 

{t-d)e- i (d+ 


m ' 


d— 1 A: 


X d t 

= 2" 2 s(a) — T 2S ((,) 


fc =0 m =0 


m> 


-^ 2 B(a) And ? 2 B( 6 ) are evaluated below 

)e -i i 

~Wt 


r __ (£ - d)e- { (d -f 1) , k ^ t m 

T W{a) ^ -E A *E~T 

fc=0 m=0 m 


(A 17) 


(A 18) 
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(t-d)e~ t (d + l)_ ^ v' A i?n 

^ ^ A m' 

m= 0 A:= n ,n 


X m t n 


X d t 


{t-d)e- t {d+^_ £ 


A d t 


=o (! - A ) 


(t-d)e~ t (d + 1) £ {Xt) 


(1 - A)A d t 


m = 0 


m’ 


dXdj-Ji) (i_ A ) t 

(l-A)A^ 


(A 19) 


T 2S( 6) = ^ E A E 


(t-d)e- t (d+ 1) ^ .,t m 


fc=0 171=0 

d-1 d-1 


m 1 


A'<t 


EE a* 

m=0 fc= n 


m' 


{t - d)e- l {d +1) g (A m - X d ) t n 


X d t 


"o (!- A ) m ' 


( ‘ ~ i)e ^ d + l) m, i -\)- d - D (A 20) 


(1 - A)A d £ 

The term T 3 can be evaluated as given below 

oo \ I n+d + 1 

r 3 = E-^ 


(1 - a )t 


to * (» + «*)' 


o-t 


A d 


e 4 

A 7 

£e -< 


oo j.i+d oo ±i+d 

(At) +d g d(A£) I+d1 


£ (. + <*-!)' .to (* + rf )'J 


d-2 / w\* 


At 


E 


(A()‘ 


de‘ 


A d 


At 


d—l 

-E 


(At) 1 


A d_1 A rf 

Then J9[<2t|A = d) is given by 


i=0 “ J ' l L t=0 

fp~~( 1“”^)^ fp~~^ f/p — /7p~^ 

I YdZlMXt d-2)- — ^ — + -y-<f>(xt, d~l) (A 21) 


A d 


E[Q t \D t = d\ - Ti- T 2 A{a) + T 2 A{b) + T 2B ( a ) - T 2 b(a) + T 3 


(A 22) 
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